Post-Markov master equation for the dynamics of open quantum systems 
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A systematic first-order correction to the standard Markov master equation for open quantum 
systems interacting witfi a bosonic batli is presented. It extends tfie Markov Lindblad master 
equation to the more general case of non-Markovian evolution. The meaning and applications of 
our 'post'-Markov master equation are illustrated with several examples, including a damped two- 
, level atom, the spin-boson model and the quantum Brownian motion model. Limitations of the 

^\ • Markov approximation, the problem of positivity violation and initial slips are also discussed. 
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The fundamental approach to open quantum systems relies on a closed system-plus-reservoir model whose time 
evolution is governed by the standard Schrodingcr or von-Neumann equation. Due to the coupled dynamics of system 
and environment, effectively, the evolution of the system's reduced density operator pt depends on its past, it is non- 
Markovian. For a quantum particle coupled to an environment of harmonic oscillators, this is obvious from its path 
\^ ' integral propagator as derived by Feynman and Vernon [0. It is also apparent from Zwanzig's projection approach 
1^ where the evolution equation for pt takes the form of an integro-differential equation involving an integral over the 
whole history of the density operator. Exactly how far back the integration over the past has to be extended defines 
the environmental 'memory' time scale r. 

A finite memory time r leads to severe problems for the treatment of open system dynamics which is even more true 
for attempts to flnd numerical solutions. Growing experimental advances on mesoscopic scales however, demand 
an efficient theory for open system dynamics beyond the standard Markov approximation: these are experiments with 
^ ^ high-Q microwave cavities, investigations of the spontaneous emission from atoms in a structured radiation continuum 
I [ (e.g. 'photonic band gap' materials) or the output coupling from a Bose-Einstein condensate to create an atom laser, 
r"| ■ to name a few. Also, the important phenomenon of decoherence which takes place on time scales that can be of the 
[ same order as the correlation time of the environment requires theories beyond the standard Markov approximation. 
^ ■ There are a few derivations of exact non-Markovian master equations for model systems (see e.g. [||-|7j). Remarkably, 
' despite the underlying non-Markovian dynamics, these exact evolution equations may be cast into the form of a time- 
local master equation involving the reduced density operator pt at time t only. A finite memory time and thus 
non-Markovian effects are exactly taken into account by suitable time dependent coefficients entering the resulting 
jj] master equation. 

Ci ^ The derivation of a useful master equation for general open systems beyond the Markov regime remains an out- 
standing open problem. In this Letter we present a first order 'post'-Markov master equation for an arbitrary quantum 
system coupled to an environment of harmonic oscillators. As in the case of the above-mentioned soluble models, our 
result takes the form of a time-local master equation with time dependent coefficients involving the bath correlation 
function. To zcroth order in the memory time (r — 0) we recover the standard Markov master equation. 

To begin with, let us recall the Markov case. From an axiomatic approach, Lindblad derived the most general 
Markov evolution equation for a density operator {h — 1): 

Pt = ~i[H, Pt] + \ ([L, ptL^] + [Lpt,L^]) , (1) 

where, for simplicity, we only consider the case of a single Lindblad operator L representing the influence of the 
environment. Such Markov Lindblad master equations are widely used in quantum optics We identify two 
'system' time scales in (0): the ordinary dynamic time scale determined by the Hamiltonian H (which we call w~^), 
and a damping or relaxation time scale (which we call 7~^) determined by the operator L^L. The true open system 
dynamics will be well described by equation (|l|) as long as terms of the order lot and 7r can be neglected, where r is 
again the environmental memory time. 
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Our aim is a 'post'-Markov master equation valid to first order in ujt, ^t. In what follows, we explain the main 
result and illustrate it with several prominent physical problems, including a damped two-level system, the spin- 
boson model and the quantum Brownian motion model. We start with a quantum system interacting with a bosonic 
oscillator environment with total Hamiltonian, 

Htot ^H + J2 9x{La\ + L^ax) + ^ ujxa{ax. (2) 

A A 

Here, H is the Hamiltonian of the system and L a system operator describing the coupling to the environment. The 
standard zero temperature bath correlation function of model (j^) is 

a(t,.) = ^5^-^-^^*-^-^. (3) 

A 

Its decay, as a function of the time delay t — s, defines the 'memory' or correlation time r of the environment. We 
choose to normalize the coupling constants g\ in (^) such that a{t, s) is normalized (J a(t, s)ds = 1) which means 
that the overall coupling strength is determined by a parameter hidden in the coupling operator L in (^. 

A lengthy derivation [ p^ based on a non-Markovian quantum trajectory approach developed recently shows 
that to first order in the memory time r the reduced density operator of model (||) evolves according to the first-order 
'post'-Markov master equation, 

pt = ~i[H,pt] (4) 
+ go{t)[L,ptL^]+g*{t)[Lpt,L^] 
+ tgi{t)[L\ [H,L]pt] ~ igl{t)[pt[L\HlL] 
52 {t) [L\[L\L]Lpt]+ g* (t) [ptL^ [L^ , L] , i] , 



where 



ffo(0 = / a{t,s)ds, (5) 







gi{t) = / a{t,3){t-3)ds, (6) 







g2{t) = / / a{t, s)a{s,u){t — s)duds. (7) 
Jo Jo 

The master equation (||) is the central theme of this paper. Note first that according to our convention, the function 
5o(i) is of the order one. Therefore, as in (^, the first two lines in (^) define the time scales lu~^ (H) and {L'^ L). 
The two functions gi{t) and g2{t), however, are of the order of the memory time r. Therefore, the third and fourth line 
in (^) are smaller than the first and second line, respectively, by a factor 7r. As r ^ 0, the third and forth line in (^) 
become negligible, the real part of go(i) tends to ^, and the contribution of the imaginary part of go(t) can be absorbed 
by a renormalized Hamiltonian: our 'post'-Markov master equation (Q) reduces to the Lindblad master equation (|l|) 
for vanishing memory time r. The third and fourth lines, which arise due to short but finite correlation time, represent 
the new first-order non-Markovian corrections. The time-dependent coefficients gi{t) describe an important initial 
slip on the time scale of the memory time r Q. Note that assuming that the initial state is factorable, is valid for 
zero temperature and also for finite temperature li L — . General finite temperatue post-Markov master equation 
can be obtained direclty from the first order perturbation of the finite temperature quantum state diffusion(QSD) 
equation |11|. 



As a first example, we consider a damped two- level system: H = ^az, L = y/j<7- ■ For the sake of simplicity, we 
phenomenologically choose an exponentially decaying correlation function a(t,s) — ^e^'*"'*'/''' with memory time r. 
Since this model can be solved exactly Ppl^], we are able to compare results from our post-Markov master equation 



Pt = -i^[az,pt] - iuj{jgi{t))[a+a^,pt] 
+7(.9oW +7.92(i))(2cr-pta+ 

-{a+a-,pt}), (8) 
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with the exact result. It here happens that the post-Markov master equation (g) is of Lindblad form with time- 
dependent coefficients (the real gi{t) gives rise to a time-dependent frequency shift). Therefore we know that pt 
remains a proper density operator for all times and all parameters. As seen in the next two examples this property is 
not a generic feature of the post-Markov master equation (^. To illustrate the limits of the Markov approximation 
we compare in Fig. 1 the average (ay) obtained from the post-Markov master equation (dashed curve), from the 
Markov master equation (dotted curve) and from the exact master equation (solid curve) for the parameters oj — 'f 
and 7T = 0.2. We see that the post-Markov master equation gives a much better result than the Markov master 
equation as expected for a significant memory time of 7T = 0.2. 

So far, our results assume a zero temperature environment. As stated before, it turns out that for a selfadjoint 
coupling operator L = the same analysis holds, with a(t, s) in (|^) replaced by the finite temperature expression 
a(t,s) = (7|[coth (^ll^) cos WA(t — s) — i sina;A(t — s)] {h = 1). A finite temperature introduces an additional time 
scale 1/kT but we here focus on the high-temperature limit kT ^ r^^, thus disregarding the new time scale. For an 
Ohmic bath we obtain the standard correlation function 

a{t,s) ^2kTA{t- s) + iA{t- s) (9) 

where A(t) is a smeared out delta function, decaying on the memory time scale r (the inverse of the cutoff frequency), 
and A is its time derivative. The precise shape of A(t) depends on the type of high-frequency cutoff chosen in the 
sum (^). Due to the somewhat singular A{t) term in (g), the coefficient gi{t) in (H) is no longer of the order of the 
memory time r but turns out to be of the same order as the zero order term go, and both terms in ^ are relevant 
in the r — > limit. The forth line in (^) involving the function g2it) vanishes for L — L^. Note that we have slightly 
changed our convention in order to be in line with standard notation: the correlation function (9) is here normalized 
such that the coefficient of the imaginary part, relevant for the damping, is unity. 

Let us consider the high-temperature spin-boson model The system Hamiltonian is H = —^a^ + ^cTz, where 
u; is the tunneling matrix element and Q depicts the bias of the system. The coupling operator is L = a/tCz- The 
'post '-Markov master equation can be obtained directly from (||): 

Pt^ - i[H,pt] 

+ igo{t)crzPtcrz - igo{t)pt + H.c. 

- iujjgi{t)axPt - ujjgi{t)ayptcrz + H.c. (10) 
After an initial slip (t 3> t), the gi{t) approach their asymptotic values and the density operator evolves according to 

Pt^- i[H, Pt] + 2kT^azPtO-z - 2kTjpt 
+ ujj{(Tx, Pt} - iujjayptaz 

+ iLUjazPtCTy (11) 

Obviously, both equation (|l^) and its asymptotic form (|ll|) are not of Lindblad form (|^) due to the presence of 
the last three terms. Therefore, as a Markov equation with constant coefficients, we cannot expect (^ij) to preserve 
the positivity of pt if applied to an arbitrary initial density operator. Our derivation shows that for the asymptotic 
equation (^) to be meaningful, one has to use an effective initial condition obtained by fully determining the 
initial slip arising from the time dependent coefficients gi{t) in the true master equation ([l0|). 

We show numerically that ( p^ preserves the positivity of the density matrix while the asymptotic equation ( |Tl| ) 
applied to the same initial condition fails to do so. The positivity of pt is equivalent to the condition ||((?)|| < 1, 
where {a) = Tr((T£) is the Bloch vector. In Fig. 2 we plot the norm of the Bloch vector using the time-dependent 
master equation ( |l0| ) (solid curve) and using its asymptotic form ( pT|) right from the start (dotted curve). Clearly, 
the latter loses positivity for some initial states on short time scales, whereas the full post-Markov master equation 
( p^ ) preserves it for all times as numerically confirmed for a wide range of parameters in the region kT ^ A = r^^, 
where A is the cut-off frequency of the heat bath. Note however that if the correlation time is too large, then the 
post-Markov master equation can also produce non-positive results as should be expected from its derivation. 

Note that this simple model is the 2-level analog of the quantum Brownian motion model where we have H ~ 
■ip^ -I- V{q) and L — ^J^q. The post-Markov master equation (^) for this case reads 

Pt = - i[H,pt] - igoRit)[q, [q,pt]] - i-igQi{t)[q^,pt] 

+ igiB{t)[q, [p,pt]] '^iigu{t)[q,{p,pt}] (12) 
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where the coefficients giR{t) , gu (t) are the real and imaginary parts of gi{t),{i = 0,1), respectively. In the special 
case when V(q) is a quadratic potential, it is reassuring that our master equation ( p^ coincides with the first order 
expansion of the exact Hu-Paz-Zhang master equation ||] . 

As in the previous example, for the high temperature Ohmic correlation function (|^), the functions gi approach 
their asymptotic values after an initial slip on the time scale r and ( p^ ) becomes the standard quantum Brownian 
motion (Caldeira-Leggett |l^]) master equation 

pt = -i[H', pt] - i-[q, {p, pt}] - lkT[q, [q, pt]], (13) 

where H' is a cutoff-dependent renormalized Hamiltonian and where we dropped a term involving rp with respect to 
a similar term proportional to q. 

It is known that the non-Lindblad master equation ( p^ ) may violate the positivity of the density operator. Our full 
post-Markov master equation ( p^ is also a non-Lindblad equation but with time-dependent coefficients. As in the 
case of the spin-boson model, their time dependence can assure the preservation of the state's positivity for a wide 
range of parameters in the validity region of Eq. (p^. In (p^), the coefficient gii{t) of the dissipative term is zero at 
t = Q and its time derivative vanishes, too. The diffusion coefficient gQR{t) also vanishes but its initial derivative is 
positive. Thus the initial phase of the evolution is dominated by diffusion. This mechanism, as is well known in the 
exact model of Ref . , may guarantee the positivity of the density matrix for short times as well as at later times 
when the dissipation enters. In contrast, the asymptotic {t ^ r) Caldeira-Leggett master equation (|l^), if used right 
from the start (t > 0), will immediately violate the positivity of a distinguished class of initial density matrices due 
to the constant dissipative term. 

It is interesting to stress the close connection between the post-Markov master equation and the QSD equation 
corresponding to (H) (see (l^). Indeed, the former was derived from the ffist order perturbation of the latter. 
Consequently, the post-Markov master equation (Q) can be simulated by using the powerfuU quantum trajectory 
techniques provided by QSD [|o|. 

To sum up, we have presented a post-Markov master equation for the evolution of open quantum systems. We have 
illustrated its great potential using several examples and we have further shown numerically that, for a wide range 
of parameters, the post-Markov master equation preserves the positivity of the density operator while its asymptotic 
version, disregarding the initial slip, fails to do so. This opens the road to applications of the post-Markov master 
equation (^ to phenomena, such as quantum decoherence and dissipation, photonic bandgaps, atom laser and more 
generally atom-field interactions in the weakly non-Markovian regimes. 
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CAPTIONS OF FIGURES 



FIG. 1. Illustration of the limit of the Markov approximation (dotted curve) for a damped two-level system. The 
dashed curve is our post-Markov result, the solid curve is the exact result. The initial state is |?/'o) = |— )■ The 
parameters are uj — ^ — 0.2. 

FIG. 2. Norm of the Bloch vector for the spin-boson model evolved with the post-Markov equation ( |l0| ) (solid curve) 
and evolved with the asymptotic equation ( pi] ) (dotted curve). As the latter leads to a norm greater than one, it violates 
the positivity of pt- The initial state is |'(/'o) = |+) and the parameters are = 0, wr = 0.01, kTr = 20, 7 = 0.3w. 
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